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Two  methods  of  testing  for  significance  of  a main  effect  in  a 
fixed  effects  two-way  factorial  experiment  are  the  method  of  fitting 
constants  and  the  weighted  squares  of  means  method.  In  the  event  that 
the  cell  sample  sizes  are  unequal  (unbalanced) , the  two  methods  can 

exhibits  higher  power,  as  a result  of  assuming  additivity  (no 
interaction)  between  the  two  main  effects.  In  the  event  that 


interaction  actually 


fitting  constants. 


recommendation  . 


the  vector  of  marginal  means,  are  the  restricted 
assuming  additivity  (restricted  estimator)  and  th 
squares  method  (OLS  estimator)  that  does  not  assu 


e additivity.  A 


preliminary 


Simulation  experiments 
and  Empirical  Sayes 


>n  significance  to  dictate  the  choice  between  the  restricted 

-Stein  and  Empirical  Bayes  methods  of  compromising  between  the 
•e  developed  for  (a-1 ) tb-1 )>3. 

le  advantages  of  the  James-Steln 

is.  A recommendation  is  made  for  the  use  of  the 

rals  for  linear  combinations  of  cell  means  are 
le  applied  statisticians.  Four  Interval 
estimation  strategies  are  described  that  are  motivated  by  the  OLS, 

simulation  of  specific  3*3  factorial  experiments,  aoverage 

four  strategies.  Other  confidence  intervals  are  found  to  have  smaller 


Confidence  i. 


average  hair  width  than  the  OLS  confidence  Interval,  at  the  expense  of 
possible  coverage  probability  reduction.  The  performance  or  the 
James-Stein  confidence  interval  is  round  to  be  slightly  more  desirable 
than  the  preliminary  test  confidence  Interval. 


This  study  addresses  two  topics  of  Importance  to  the  statistician 
analyzing  data  from  a two-way  factorial  experiment.  The  first  topic  is 
the  testing  for  signiflaanae  of  main  effects.  The  second  topic  is  the 

le  objective  in  chapter  2 is  to  compare  power  and  type  I error 

significance  of  main  effects.  The 

effects,  unconditionally.  In  the 
I to  conflicting  ce 


e powerful  mi 


assuming  additivity 

(unbalanoe),  the  two  methods  ir 

additivity  exists.  If  nonaddlttvlty  occur 

case  and  several  patterns  of  unbalance,  ti 

The  main  objective  for  the  remainder 
the  practical  value  of  using  compromise 
marginal  means.  Specifically,  compromises 
assumes  additivity  and  the  estimator  that  allows  nonadditivity  ari 
alder ed.  The  types  of  compromise  estimators  in  question  are  the  . 
Stein  and  Empirical  Bayes  shrinkage  estimators.  These  estimators 


compared  with  the  ordinary  least  squares  and  preliminary  test  estimators 
in  a series  of  Monte  Carlo  experiments.  The  criteria  for  comparison  are 
how  close  the  estimators  tend  to  be  to  the  true  cell  means  (and  marginal 
means),  as  well  as  size  and  coverage  probability  of  confidence  intervals 
based  on  the  various  estimators.  Implicit  in  this  objective  Is  the 


understandable  to  the  average  applied  statistician.  A large  vc 

estimator  and  a restricted  least  squares  estimator, 
problem  in  the  two  way  factorial  experiment  is  treated  as  a specific 
application  of  these  estimators.  Examples  are  inoluded  to  demonstrate 
the  computations  required  to  make  u3e  of  compromise  estimators. 


A factorial  experiment  is  an  experiment  in  which  all  combinations 


of  the  levels  of  the  factors  being  studied  are  applied  to  experimental 


units.  Some  of  the  early  work  done  on  the  statistical  methodology 
associated  with  factorial  experiments  appears  in  Yates  (1935).  Since 

books  on  experimental  design  and  analysis  (see  Coohran  and  Cox  (1957), 
Steel  and  Torrie  (1980),  and  Bancroft  (1968)).  This  experiment  may  be 
laid  out  in  one  of  many  possible  designs  (e.g.  completely  randomized, 


experiment 


experiment 


comprise 


larger  population  of  levels  of  R,  and  It  la  the  larger  population  of 


A fixed  effects  factorial  experiment  Is  one  In  which  all  factors 
being  applied  are  fixed  effects.  A random  effects  factorial  experiment 
is  one  in  which  all  factors  being  applied  are  random  effects.  A mixed 
model  factorial  experiment  is  one  In  which  some  of  the  factors  being 
applied  are  fixed  effects,  and  seme  of  the  factors  being  applied  are 

Any  number  of  factors  can  be  studied  In  a factorial  experiment.  In 
this  discourse  the  case  of  two  factors  is  studied.  This  case  will  be 
referred  to  as  a two-way  factorial  experiment. 

The  two-way  fixed  effects  factorial  experiment  laid  out  in  a 
completely  randomized  design  is  described  as  rollows: 

The  efTect  of  two  factors  A and  B on  a stochastic  response, 

qualitative  levels,  indexed  1-1 ,2,..., a.  The  factor  B takes 
on  multiple  qualitative  levels.  Indexed  J-1,2,...,b.  The 


M-iSt  jE?  nij  1 


A-  A-  Aj-Aj" 


«.  - S.  - V - Y.J  - 0. 


“id'  “ * V V V 


models  through  matrix  algebra,  refer  to  Searle  (1971). 
Hypothesis  Testing 

or  almost  every  situation  In  which  linear  models  such  as  0.1.  l) 


hypotheses  about 


hypotheses 


A linear  hypothesis  about  parameters  In  a linear  model  may 
hypothesis  H0:  li j I - 2 - U)  3 may  be  written 


In  this  discourse  the  restriction  matrices  considered 


elements 


hypothesis 


"o’ 


Not  Hq, 


(Ru-r)'(R(X'X>',R,)'l(Ru-r) 


where  u - (X’Xj'Vjr  , s2  - < jr— X^i)  ’(jt-Xjj) /(N-K)  and  rank  (R)  Is  the 


elements  In  _u.  Then,  assuming  Hq  Is  true,  F ha 
distribution,  with  degrees  of  freedom  rank(R), 
has  the  noncentral  F distribution  with  degrees 
X,  and  noncentrality  parameter 


freedom  rank(R)  an 


( *11  •'  *16.'  y2C> 

•e  y - (V  , ) / n Sane  properties  of  'E  are- 

» > - Hand  Vert  j,  ) - (X'XfV  • Diag(  n,,.  n,2  .... 


where  R - M : ) © (M  : >.  The  a. 


(1.1.7) 


!(  u ) - u - HR  y 


f the  cell  means  a'u.  Var(a'y)  s 


“i-  ‘ “u  1 


These  marginal 


vector  notation  is 


The  symbol  (■)  denotes  1 


product, 


Graybill 


The  purpose  or  this  study  is  to  seek  ar 
racing  the  applied  statistician  analyzing  tl 
effects  factorial  experiment.  The  question? 


questions 


1*2.1  Which  Test  Statistic  Is  Best? 

In  the  two-way  fixed  effects  factorial  experiment  and  for  the  model 
given  in  (1.1.1)  the  following  hypothesis  is  often  tested: 


computer  procedure  SAS/GLM  calls  this  conditional  test  the  "Type  II  F- 
test."  The  hypothesis  in  (1.2.1)  can  be  tested  unconditionally  using 


the  techniques  described  in  section  1.1.  This  unconditional  test  arises 
free)  the  "weighted  squares  of  means  method."  The  computer  procedure 


1.2.2  Should  Biased  Parameter  Estimates  Be  Used? 


In  section  1.1  two  estimators  of  the  parameter  vector  ji  are 
given.  The  OLS  estimator  in  (1.1.6)  Is  unbiased,  while  the  restricted 
estimator  in  (1.1.8)  is  biased.  In  general.  There  are  numerous 
estimation  strategies  that  attempt  to  compromise  between  (1.1.6)  and 
(1.1.8).  These  compromise  estimators  are  themselves  biased.  In  chapter 


ced  effects  factorial  experiment,  and  their  performance  I) 
Finally,  in  chapter  8,  confidence  Intervals  associated  w: 
developed  and  applied. 


Specifically,  cl 


! weighted  squares  ol 
.n  unbalanced  ANOVA. 


e description  of  a factorial 
ijj  observation  y ; j w , k-1 


population  corresponding  to  levels  1 of  A am 

mean  of  the  ij  population.  Assume  V(yj > - 
and  that  all  y^  are  mutually  Independent  ar 
Reiterating, the  cell  means  model  Is  yjj,,  -u,. 
independent  and  normally  distributed  with  var 


, Independent  of  1 and 
normally  distributed. 


Interaction,  respectively. 


Specifically,  : 


ir  equivalently  H®: 


Zn  many  applications  this 
to  analyze  simple  effects. 

Several  papers  have  addressed  tf 
unbalanced  data,  notably  Yates  (1934) 
discussions  are  offered  by  Bancroft  ( 
Torrle  (I960),  (1980),  and  elsewhere. 


the  possible  presence  o 


c of  hypothesis  testing  in 
is  early  years.  Textbook 


it  interest,  due  largely  to  the  variety  of 
computational  procedures  available  in  computer  packages  such  as 
Survey  papers  are  given  by  Speed,  Hooking,  and  Hackney  (1978)  a 


Searle,  Speed,  and  Henderson  (1981).  A primary  focus  of  these  writings 
has  concerned  the  concept  of  the  "hypotheses  tested"  by  the  F-tests 
based  on  the  various  sums  of  squares  in  an  analysis  of  variance.  The 
term  "hypotheses  tested"  can  be  explained  as  follows:  An  F-statlstic  in 
a fixed  effects  model  has  a noncentral  F distribution.  The  "hypotheses 
tested"  by  an  F-test  are  a set  of  equations,  linear  in  the  parameters, 
that  are  true  if  and  only  if  the  noncentrality  parameter  is  equal  to 


zero.  Thus  the  F-statlstie  has  a central  chi-square  distribution  when 
the  "hypothesis  tested"  is  true.  Hence  a critical  value  Pa  can  be 
determined  so  that  the  rejection  probability  is  equal  to  the  prescribed 
a when  the  hypothesis  tested  is  true  and  greater  than  a when  the 


hypothesis  tested  is  raise.  Put  another  way,  an  F-statlstlc  tests  Hq  if 

Hq  if  it  is  biased  for  that  is,  if  the  rejection  probability  can 
exceed  the  prescribed  a when  Hq  is  true. 

The  intent  of  this  chapter  is  to  weigh  the  merits  of  two  methods  of 
testing  hJ  . These  methods  are  the  "method  of  fitting  constants"  and 
the  "weighted  squares  of  means".  (See  Searle  et  al.,  1981 . > The  method 
of  fitting  oonstants  tests  assuming  the  Vjj's  are  all  zero.  The 
weighted  squares  of  means  method  does  not  make  that  assumption.  The 
computer  package  SAS  presents  test  statistics  for  both  methods  in  PROC 


statistics  corresponding  to  the  method  of  fitting  constants  and  the 
weighted  squares  of  means  method,  respectively.  Henceforth,  in  this 


work  the  terminology  of  SAS  will  be  used  in  the  interest  of  brevity. 
Speed,  Hocking,  and  Hackney  (1978)  presented  the  linear  functions 


well  as  several  other  types.  In  particular,  they  stated  that  the  Type 


III  F-test  does  test  H*  = J,. 
does  not  test  H$  . This  same 


terminology  by  Bancroft  (1968) 


<2)  *ijK  - » * “i  * 6j  * 


<3)  y1Jk 


eijk- 


('ll  y,Jk  ■ u * 6 j 


'ljk- 


it  denote,  respectively,  the  residual  sums 
ror  factor  A are  then  expressible  in  the 


SSA(II)  - R(a|u,8>  - SSE  „ - SSE  2 

R*  notation  of  Searle  (1931).) 

If  all  njj  are  equal,  then  SSt  (11)  . SSfl  (III) s otherwise 
Inequality  holds,  generally. 

Referring  to  the  R notation,  the  following  guidelines  are  now 


assuming  Hp 


presence  or  absence  of  interaction.  In  application,  however 
analyst  rarely  knows  whether  interaction  is  present.  In  fac 
interaction  is  probably  always  present,  at  least  in  a minute 
common  practice,  which  is  suggested  by  Bancroft  (1968),  is  t 
all  test  for  significance  of  interaction  at,  say,  the  a - .5 

significant  (and  main  effects  are  still  of  interest) , 


probability  of  rejecting  hJ  will  be  larger  than  the  prescribed  a;  i 
the  type  I error  rate  is  inflated,  and  amount  of  inflation  depends  oi 

type  II  F doe3  not  test  . Further,  the  probability  of 
rejecting  Hq  when  Hp  is  false  (the  power  of  the  test)  depends  on  the 
this  dependency  can  result  in  either  an  increase  or 


The  type  III  test  always  gives  an  unbiased  test  of  Hp  , 
rejection  probability  is  equal  to  a under  Hp  regardless  of  tl 


e (1960)  and  Bancroft  (1968) 


If  interaction  is  absent,  then  the  type  III  test  is  lneffloient. 
Specifically,  the  power  of  the  type  Iil  test  is  less  than  the  power  of 
the  type  II  test  In  the  absence  of  interaction,  due  to  the  superrious 
estimation  of  zero-valued  interaction  parameters.  The  practical  issue 
when  small  amounts  of  interaction  are  known  or  suspected  to  exist 


power  deficiency  in  the  type  III  test. 

Whereas  the  Issue  of  what  hypothesis  is  being  ti 
has  been  extensively  discussed,  relatively  much  less 
about  the  amount  of  bias  terror  rate  inflation)  in  the  type  II  test  whe 
interaction  Is  present.  Also,  relatively  little  has  been  reported  on 
the  degree  of  Inefficiency  of  the  type  III  test  when  Interaction  is 
absent.  Gosslee  and  Lucas  (1965)  make  limited  power  computations  for 

Cramer  and  Appelbaum  (I960)  debate  related  Issues  primarily  regarding 


is  purpose  or  this  chapter  Is  to  assess  rejection  probabilities 
>es  II  and  III  F-tests.  Specifically,  < 


le  amount  of  inflation  in  the  type  1 erro 
t F-test  in  the  presence  of  interaction, 
le  loss  In  power  ( Inefficiency)  of  the  tyi 
le  absence  of  lnteratlon. 


Interaction 


focused  primarily  01 


2.2  Power  Function 

In  the  notation  above,  the  two  F-tests  considered  for  an  A main 


) - ms#(ii)/mse 


FaUII) 


y __  - ( s’Hj 


Specifically, 


Cy.i  -y„  *7,,  -y„l‘ 


Note  that  proportional  data  structure  n,  ,n22  - n,2n2I  Is  not  sufficient 

The  F statistics  corresponding  to  SSA(II)  and  SS.(m)  have  non- 
central F distributions  with  noncentrallty  parameters 

* h,(ii,,-  uJa)]> 

A 2(h,*h,)(2o’) 

[(h,»h,)(0|-a,)«h|(T,,-yi,).h,(T„-T„)3» 

aCh.'hjJUo’) 


not  necessarily  equal  to  zero  when  hJ  is  true.  Mote  also  that  1#(III) 
Coes  not  depend  on  T,, . so  that  1#(III)  - 0 If  hJ  is  true. 

parameters.  The  power  1-fi  can  be  computed  using  equations  given  in 

Note  that,  in  addition  to  the  model  parameters,  the  noncentrality 
parameters  (and  hence  the  powers)  depend  on  the  values  or  h1  and  ho. 

Some  specific  aspects  of  the  dependency  are  now  discussed  in  the  context 


of  a fixed  total  sample  size  n,,»  n,2*  n2,»  n^.  «0.  Now  0 < h,»  h2  < 
20,  so  the  possible  points  (h^,  h2)  lie  in  the  region  as  depicted  in 


. Selected  points  in  Figure  : 
1 frequency  distribution. 


identified  with  the 


It  was  pointed  out  earlier 
Kg  : p , - ...  - u . Therefore 


e rejection  probability  (type  I 
prescribed  o,  depending  on  the 


I'll-  If  T,,  - 0,  then  both  FACII)  and  FA(III)  are  unbiased.  Comparison 
of  »A(II)  and  »A(III)  when  1,,  - 0 shows  lA(II)  > »A(III)  with  equality 
only  If  h,  - h2.  Powers  of  FA(II)  and  FA(III)  for  o,  - .5o  are  shown  In 


(h2-  h,  )Tn  - {h,  + hjlo,.  Large 


I,  =0,  0,  - 0,  y„  =.5c 


Figure  2.2  Type  I Error  Rate  of  F,( III . 
of  PA(II). 
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Figure  2.3  Power 


Rejection  probability 


a, =5a,  ,0=0,  y„  -0 


1.00- 


Figure  2.5  Rejection  Probability  of  F#( II) . 
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0 (Comparing 


As  noted.  Bancroft  (1968)  suggests  testing  h^B:  Y 
models  O)  and  (2)  in  (2.2.1))  at  o ■ .25.  and  recommends 

1.  testing  H*  with  Fft< II)  if  the  test  of  hJB  is  nonsignificant,  or 

2.  testing  Hg  with  III)  if  the  test  of  is  significant, 
provided  the  main  effect  hypothesis  1C  Is  still  of  interest. 

Figure  2.6  shows  the  power  of  the  o - .25  level  interaction  test  with 
Yj | - .5o  as  a function  of  hj  and  h2.  Selected  power  computations  are 


the  same  form  as  the  power  of  FA(III),  and  is  thus  most  adversely 
affected  when  h1  and  h2  differ  greatly.  Note  that  for  the  case  n,  1 - 
20,  n2,  - 10,  nI2  - 7,  and  n22  - 3,  the  power  Is  only  1-BU)  - .73. 
Thus,  for  this  particular  design,  even  using  Bancroft's  suggested 
procedure,  the  probability  is  fl(A)  - .27  of  Incorrectly  assuming  no 
interaction  and  thus  being  led  to  the  use  of  F*(II).  And  this  in  turn 
could  lead  to  excessive  rejection  probability  if  H*  : a,-  0 is  true. 

reoognlzes  that  SSA(II)  and  SSA(III)  derive  from  the  contrasts 


.(III) 
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*VS** S’“““ 


»#(III)  - 2b2  a?/(^hj’(2o2)). 
n of  1 A( I I ) and  reveals  Chat  the  cone 


fa(hi). 


fa(II) 


Fa(III). 


In  this  chapter,  several  biased 
In  linear  regression  are  discussed, 
established  to  allow  comparison  of  the  quality  ol 
another.  Therefore  In  section  3.2,  risk  functions  are  Introduced  as  i 
section  3.3  the  widely  used  preliminary  tea' 
In  section  3.k  the  groundwork  Is  laid  for 
"shrinking"  an  estimator  toward  a subspaoe.  Two  types  of  shrinkage 
estimators  are  then  generalized  to  shrink  toward  a subspace. 


2 Criterion  f< 


n Estimators 

efficiency,  consistency,  etc.),  but  there  la  rarely  a single  "best" 
estimator  In  terms  of  all  of  these  qualities.  Because  of  this,  one  1 
decide  which  attribute  or  combination  of  attributes  Is  important,  an 
■r  accordingly. 

.0  evaluate  the  goodness  of  an  estimator  Is  to  study  th< 


example. 


expected  s 
function: 


, the  statistician 
distance  from  the 


all  possible  values 


where  D is  a symmetric  (K*K)  matrix  of  weighting  constants.  Hence  the 
risk  described  in  (3,2.2)  is  referred  to  as  weighted  risk  when  D » I. 


In  the  factorial  experiment,  it  may  be  that  estimates  of  the  celt 
means  are  to  be  used  to  get  estimates  of  the  marginal  means,  jj^,  as 
described  in  (1.1.9).  In  that  case,  a risk  function  measuring  expected 

means  is  needed.  Such  a risk  function  is 


Ri(  ®M  • >£«  > ■ Et 


J1h>  > • 


Using  0.1.9). 


Xa®li 

O ® !„ 


(£-£> 


"better"  than  9 If: 


goodness  criterion, 


possible 


possible 


less  than  or  equal  to  the  supremum  of  R ( 8 , £ ) over  all  £ for  any 


3.3  Preliminary  Test  Estimators 
Simply  put,  a preliminary  test  estimator  is  an  1 

hypothesis. 


estimated,  then  a preliminary  test  estimator  would 


s rejected. 
3 acoepted. 


where  £,(x)  is  an  estimator  of  0 that  is  appropriate  in  the  case  that  H0 
i3  false,  and  0a(x)  is  an  appropriate  estimator  of  0 when  H0  is  true. 

For  general  linear  regression  models  the  vector  of  unknown 
parameters  is  often  estimated  using  a preliminary  test  estimator. 
Suppose  X 1s  (NxK)  rank  K,  £ is  (N.1),  and  9 is  (K«l)  unknown.  For  the 


ordinary 


squares  estimate 


(X'X)'1 
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suspected  that  R8  ■ r,  where  R Is  ( J»tt)  of  rank  J i K,  and  r_  Is  (J*l). 
Recall  from  the  section  on  parameter  estimation  In  chapter  1,  if  Rg  - r 
were  known  to  he  true,  the  restricted  least  squares  estimator  is 


and  Judge  (1973).)  When  a 


test  of  the  hypothesis  Hq:  RJL  ■ £ is  used  to 


determine  if  t)  or  6 will  be  used  to  estimate  £,  a preliminary  test 


l1i 


if  H0  is  rejected, 
if  H0  is  accepted. 


critical  value  used  in  the  test.  Using  the  standard  indicator  function 
notation,  the  preliminary  test  estimator  is  given  in  Bock,  Yanoey  and 
Judge  (1973)  to  be 


A bibliography  of  studies  on  preliminary  test  estimators  is  given 


Bancroft  and  Han 
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properties  of  preliminary  test  estimators  for  the  general  linear 
models.  Sclove,  Morris,  and  Radhakrishan  (1972)  criticize  preliminary 
test  estimators,  calling  them  non-optlmal.  More  recently,  Bickel  (1981) 
discusses  the  robustness  of  preliminary  test  estimators  as  compared  to 

Several  of  these  authors  conclude  that  a preliminary  test  estimator 
Is  an  undesirable  choice  of  estimator.  Nevertheless,  preliminary  test 


3.t  Shrinkage  Estimators 

A shrinkage  estimator  of  £ Is  a functional  combination  of  two 
estimators  of  £,  e,  and  0,  say.  Typically,  a,  Is  the  maximum  likelihood 
estimator,  and  0,  Is  some  other  estimator.  The  estimator,  0,  might  be 


and  inconsistent.  By  using  the  shrinkage 


between  the  good  and  bad  properties  of  0,  and  02  is  attained. 

The  prototype  of  shrinkage  estimators  was  proposed  by  James  and 

proposed  by  Berger  (1976a),  Strawdermann  (1971),  and  Efron  and  Morris 
(1973),  as  well  as  many  others.  These  estimators  were  originally 
proposed  as  compromises  between  xt  the  ordinary  least  squares  (OLS) 


estimator,  componentwise  as 


general  shrinkage 


dimensionality 


greatest  advantages  of  using 


shrinkage  e! 
shrinkage  estimator 


in  practice. 


where  M-tX'xr'R'tRU’Xr'R')'1 . In  the 
shrinkage  estimator  of  R£,  compromising 


estimator,  o is  a 


OLS  estimator  of  £ in  a linear  regression  model. 


The  motivation  for  dealing  with  estimators  in  the  form  stated  In 
{3. **.2)  comes  fran  the  preliminary  test  estimator  as  stated  in 
(3>3.6).  One  can  see  that  the  preliminary  test  estimator  has  the  form 


Unna  3.1.1:  For  B of  the  fora 


In  (3.H.2),  If  o Is 


R(  8 , 8 ) - R(  (I-HR)b  , (I-MR)6  ) ♦ R(  Mo  ,MRB  ),  (3.«.3> 


8 - B ■ (I-MRX  b - B ) ♦ HC  « - RB  ). 

R(  B . 6 > - R(  (I-HR)b  , U-MR)8  ) • R<  hto  . MRS  ) 
•2  E(  (o-RB)’H'  D (I-HRXb-BJ  ) . 


- xs'V) 


- MR)  b> 
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(I  - HR)  b>  - 0 . 


(0, oaI) 


Baranchik  C 1 9S*4 ) 


(1966). 


developed 


positive 


The  James-Stein  estimator  as  presented  by  Judge  and  Bock  (1978,  p.  179), 
BS  ■ (1-c/F)  « , (3. «. 5) 


where  c-(N-p)(p-2)/((N-p*2)p)  and  P«  x'  7 /psa  is 


F distribution  with  p and  (N-p)  degrees  of  freedom 


i noncentrality 


R)(  8 , JO  will  be  minimized.  The  discussion  of  the  role  of  the 


constant  c will  be  taken  up  shortly. 

The  James-Steln  estimator  as  given  in  (3.9.5)  may  be  restated  as 


(3.9.6) 


tn  componentwise  a: 


(o/F) 


t (3.«.7>  has  t 
Morris  (1973)  a 


le  general  shrinkage  estimator  ol 


! F statistic,  V 
>r  example.  If  c 


depending  on  the  observed  value  of  the  P statistic.  S' 
quite  different  from  x. 

Depending  upon  the  chosen  criterion  for  goodness 

example,  If  unbiasedness  Is  the  ultimate  criterion  foi 

goodness  13  the  risk  function  Rt ( • , • 1 as  described  In 
and  Bock  (1978,  pp.  177-179),  analytloally 


as  the  risk  function  In  evaluating  goodness  of  the  estimator,  is 
o - (N-p)(p-2)/(p(M-p*2>). 

If  rather  than  a compromise  between  x and  £,  a compromise 
shrinking  x toward  Sq  is  written 


»-p)(p-2)/((N-p*2)p), 


one  that  testa  HQ:  £ - £,  rather  than  H0:  0 « 0.  Thta  extension  Is 
dlsoussed  In  Judge  and  Book  <1978,  p.  180). 

the  James-Steln  estimator  la  better  than  the  MLE.  Judge  and  Bock  (1976, 
pp.  85  and  179),  report  the  risk  function  of  the  James-Steln  estimator 


o'<  p " Siyrg  1 E(V0)  ' (3.8.9) 


Judge  and  Bock  0976)  give  the  graph  of  these  risk  functions  for 
Increasing  X as  shown  in  Figure  3*1.  Notice  that  R,(8  , 9)  < R,(x  , 8), 


One  unfortunate  property  of  the  estimator  In  (3.8.5)  is  that  c/F  Is 


probability  tha 
Interval  C*),x3. 


be  less  than  or  equal  to  1 . There  Is  a nonzero 
(c,  allowing  c/F>1 . Thus  8s  can  fall  outside  the 
b alleviate  this  possibility,  the  James-Steln  positive 
developed  by  Baranchlk  (1968)  and  Stein  (1966). 


Bock  (1978,  pp.  182-188)  may  be  written 


“3 


Estimators. 


(Adapted  from  Judge 


I,e,/F) 


( (p-2)<N-p)/«ll-p*2)p)  , 2(p-2) (N-p)/((N-p*2)p)  ] 


and  F la  the  likelihood  ratio  teat  atatlatlo  of  Hg:  5 - 0,  aa  In 

role  analogous  to  the  shrinkage  constant  In  the  ordinary  James-Stein 
estimator.  In  this  case,  there  la  no  single  choice  of  c<  that  leads  to 
a best  estimator  using  the  criterion  for  goodness  based  on  Rj ( - . - ) . 

Stein  positive  part  estimator  that  Is  better  than  the  ordinary  James- 
Steln  estimator.  See  Judge  and  Bock  (1978,  p.  180). 


the  estimators  fall  on  the  segment  or  ray  depends  on  the  data  through 
the  F statistic. 


and  (3.0.11)  that  exhibit  superior  performance  relative  to  the  OLS 


and  (3.0.11)  degenerate  to  the  OLS  estimator.  It  la  generally  perceived 


advantages  of  shrinkage 


Judge  and  Bock  (1978,  p.  2«1),  generalize  the  James-Stein  and 
James-Stein  positive  part  estimators  to  allow  shrinking  b toward  la.: 


:e  eventual  li 
interaction  In  the  factorial  experiment  towar 
additivity  (no  interaction)  may  he  written  u: 


».  The  constraint  ol 
le  appropriate 


restriction  matrix  as  Ru-0.  Therefore,  the 
discussed  subsequently  will  shrink  b.  toward 


£:  IRB.  - 0|. 


estimator  of  S is  b-S~'x’£.  Assuming  that  R B - 0,  where  R is  (J»K>  of 


M • S 1 a1 ( RS  1 R ' ) To  Insure  that  b and  £ can  be  computed  it  is 
required  that  JSKSN.  Rather  than  take  b or  g as  the  estimator,  the 
generalized  James-Stein  estimator  Is  a compromise  between  b and  a . 
Since  this  generalized  James-Stein  estimator  is  essentially  shrinking  Rb 

generalized  James-Stein  estimator  as  given  by  Judge  and  Bock  (1978)  may 


shrinkage 


likelihood 


( RB-O) • ( H( X ' X) '' R ' ) ( nb-O) ( N-K) 

F ' JljMiW  ■<*->&> 

statistic  of  Hqi  Rb  - 0 . This  test  statistic  has  the  F distribution 
with  J and  ( N-K)  degrees  of  freedom  and  noncentrality  parameter 

A • (R£-0)'(R(X'X)''R')"'(Ri-0)/2o2.  (3.4.13) 


s being  a compromise  b( 


estimator  may  be  rephrased  as 


BS  - (I-NR)b  * MaS  , (3.#.  id) 

where  aS  - (1-c/F)  Rb.  The  equlyalency  can  be  seen  by  observing  the 
following: 

8 - (1-c/F)B  * (c/F)(I-MR)b  (from  (3.4.12)), 

- [ ( 1 -c/F) ( I-MR)b  * (1-c/F)MRb]  * [(c/F)(I-MR)b  * (o/F)0]  , 

- (I-MR)b  » M[(l-c/F)Rb)  . 


I,  the  shrinkage 


through  the  F statistic,  will  be  allowed  to  influence  the  value  of  the 
estimator  away  from  the  OLS  estimator.  In  this  more  complex  setting, 
the  optimal  oholce  of  value  for  c is  not  so  clear.  The  constant  c must 
be  chosen  to  allow  a to  be  best  with  respect  to  the  weighted  risk 
function 


(3.1.15) 


By  inspection,  o'*  i: 


(b-S) • R1 ( ns"’ R1 >■' R(b-8)/(HSE- J) 
function  of  / only  through  MSE  and  fto. 


In  the  special  ease  t 
2)/<J(N-K-2>)  allows 


proportional  to  I then  c-(N-K)(J- 


A corresponding  generalized  James-Steln  positive  part  estimator  Is 
implied  but  not  explicitly  stated  by  Judge  and  Bock  <1978).  The 


min(l,c,/F)  £ t <3. 4.16) 


where  c,  Is  a shrinkage  constant,  and  F is  as  described  in  <3.9.12). 

The  estimator  in  (3.9.16)  may  also  be  written  in  the  form  of  (3.9.2),  as 
follows: 


where  a + - <1-min(1  ,p^-))Rb.  The  oonstant  c1  plays  precisely  the  same 
role  as  the  constant  In  (3.9.11).  Any  choice  of  C|  in  the  interval 


< (J“2)(M-K)/((N-K*2) J) , 2( J-2) (N-K)/( (N"K+2)J)  ] , 


will  lead  to  a minlmax  estimator  of  £ if  M'M  is  proportional  to  I. 
Otherwise,  some  values  of  c1  In  the  above  interval  will  not  necessarily 
lead  to  a minimax  estimator  of  At  the  end  of  this  section, 
conditions  for  minimaxlty  are  given. 


and  (3.9.16)  is  that  every  element  in  Rb  is  adjusted  toward  0 by  the 
same  amount.  Intuition  (and  Empirical  Bayes  methodology)  suggests  that 
the  variance  of  Rb  should  be  allowed  to  influence  the  amount  of 


discussed 


section  shrinks 


element 


linear  regression  equation, 


Rjt’,*)  if  o is  minimax  with  respect  to  the  weighted  risk  function 


R<  a , RS  > - E[( 


for  a to  achieve  the  desired  mlnimaxlty  are 


.21 ) are  sufficient 
n positive 


o sufficient  f< 


lure  that  £ Is  minimax.  Because 
provides  uniform  Improvement 
conditions  (substituting  c,  for  c) 


! Empirical  3ayes 

.1  the  classical  Bayes  parameter  estimation  technique: 


1.  A prior  distribution  of  the  parameter  0 is  proposed;  g (0). 

2.  Data  are  collected,  and  the  likelihood  function  Is  used  to 

parameter  8.  The  likelihood  function  Is  the  conditional 
distribution  of  x given  8;  f(x|e). 

3.  Using  the  prior  distribution  and  the  likelihood  function  a 
posterior  distribution  of  8 given  x is  computed;  h(0|x). 


When  the  prior  distribution  of  8 is  N(80.Ta)  and  the  likelihood  function 
Is  the  density  function  for  a 11(8, a1)  distribution,  the  posterior 


6,1*!  - 8(0-8,)*,.  0-8,36,). 


1 1 

? - «*,  * v * «/■«,.  • v'  ■ 

xa, -i,  1«,  ih.  -u...  a I,  .r. 

yy<‘.  • y‘> 

*'•  AW/> 

ere  Bj-txj-djDjJ/dj . If  D,.D2 Dk  are  also  unknown, 
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V 1 ji!  '£)  >'"1  • *• 


Since  o!a/oj  Is  unknown,  the  data  must  be  used  to  estimate  it.  An 
unbiased  estimator  of  v - oa/oa  is 


has  the  central  F distribution,  with  k numerator  degrees  of  freedom,  and 
N-k  denominator  degrees  of  freedom.  The  expected  value  of  a F 
distributed  random  variable,  with  N-k  denominator  degrees  of  freedom  is 
(N-k)/(N-k-2).  Applying  algebra  to  the  expected  value  of  the  expression 
in  (3.  A. 33), 


Solving  for  a /a  , 


(3. «. 35) 


Substituting 


where  constant- ( N-k-2) (k-2) I (N-k*2) k . 


estimator  when  all  the  nt ' s 


The  value  of  using  this  modification  Is  that  It  Is  noniterative, 
allowing  easy  computation  In  practice.  Ghosh  and  Meedan  (1986)  use  a 
closed  form  estimator  of  the  variance  ratio,  v,  to  develop  an  empirical 
Bayes  estimate  of  the  mean  vector  in  a finite  population  sampling 
problem.  Their  estimator  differs  fron  (3.H.31 > only  by  a constant. 

For  both  the  Efron-Morris  estimator  and  the  modified  estimator  in 
<3.«.36>.  a positive  part  version  can  be  developed.  As  with  other 
shrinkage  estimators,  the  positive  part  version  would  be  recommended  for 

The  empirical  Bayes  estimator  In  (3.A.36)  can  be  generallted  to 
compromise  between  b and  £ following  the  estimator  form  In  <3. A. 2).  As 
always,  let  £ • X£  * e , where  £ Is  (N*l),  X is  (N*X)  of  rank  K,  8 is 
the  (K«! ) vector  of  parameters,  and  £ - HN(£,o  I).  Further,  assume  that 
the  prior  distribution  of  RJ3  is  N,(0, o -I) , where  R Is  (J*K)  of  rank  J 
such  that  RR'-I.  If  a and  o R were  known,  the  posterior  distribution 
of  R£  given  Rb  would  be 
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P to  be  an  orthogonal  transformation  matrix  that  diagonalizes  Var(Rb). 


(3.1.38) 


r distribution  fc 


The  posterior  distribution  of  V | t is  then 


The  posterior  variance  w - diag  < W, , W2 Hj  ) . Each  diagonal 


Transforming  back,  the  posterior  distribution  of  R£  given  P!>  is 


An  estimator  of  £ of  the  form  given  in  {3-A.2),  using  a as  the  estimator 


(3.«.«8) 
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In  other  sections).  When  o and  o R are  unknown,  an  empirical  Bayea 


(3.8.8$). 

empirical 


can  be  developed  by  substituting  an  estimate  or  o -/o 


where  v - C < H-K-2> F/{ M-KJ  - 1]  J/trKRS'Vr1)  is  an  estimator  or 
8 ■ (N-K-2)(J-2)/(N-X*2)J  . and 

t - [(Bb)'(Rs",R,)',Rb(ll-K)3/[J(i-Xb),(£-Xb)]  is  the  likelihood  ratio 


type  argument  as  was  given  in  (3-8.33)  through  (3.8.35). 


A positive  part 
tij.b,)  would  be 


, constraining 


(3.8.51) 


CHAPTER  A 

TWO-WAY  FIXED  EFFECTS  FACTORIAL  EXPERIMENT 

In  chapter  3,  several  shrinkage  estimators  were  discussed  in  the 
generalized  framework  of  linear  regression.  In  this  chapter  the 
estimators  described  In  chapter  3 are  applied  to  the  two-way  fixed 
effects  factorial  experiment.  This  application  parallels  the  work  of 
Lee  (1983),  but  is  approached  from  a slighty  more  applied  point  of 
view.  After  describing  the  various  shrinkage  estimators  in  terms  of  the 
factorial  experiment,  examples  of  the  applications  or  each  are  given. 

In  order  to  evaluate  the  relative  quality  of  the  various  estimators, 
Monte  Carlo  comparisons  of  the  positive  part  versions  of  the  shrinkage 
estimators  are  reported. 

k. 1 Application  of  the  Estimators 


effects  factorial  experiment,  written  in  matrix  notation  is 


> 

e hy  ' < J“yijfc,/nij  • 


. where  R - (-I.I,,.,,  ) © M:!,,.,,  ) 


■£*•  «1'  R“  *»•  T test  1( 

(nu)-taS-’R-)-’(4)  ih 
(a-1  ){b 


in  square  attributed  t< 


the  AB  Interaction  In  the 
to  experimental  error. 


numerator  degrees  of  freedom,  (N- 
noncentrallty  parameter 


denominator  degrees  of  freedom. 


The  standard  decision  rule  Is  reject  Hq  If  F 1 c,  and  accept  Hq  If  F 
c,  where  o-o(o)  is  a constant  chosen  so  that  PrlFBo(a)  | H-  Is  true) 
{type  1 error  rate). 

A. 1.1  Conventional  Strategy  Estimator 

Being  unsure  of  whether  H0  is  true  or  false,  the  conventional 
strategy  for  estimating  _u  may  be  stated  as  follows: 

1)  Test  Hqs  Ru  - 0 using  the  F test. 

2)  If  H0  is  rejected,  then  use  ji  as  the  estimator  of  jj. 

The  conventional  strategy  is  Itself  an  estimator,  and  will  be 


it  a 


Rt,  (*.1.7) 


n (*.1.7>.  u Is  in  the  f. 


In  (3.‘ 


) t * O-mlnit.o./Fl)  u , («.1. 
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If  iij  violates  C e,  , u(  ] toward  Uj  , 
If  ii|  violates  [ u,  . u,  ] toward  u,  . 


(d.1.13). 


The  checklist  In  Table  0.1  indicates  the  summary  Information  needed 
to  evaluate  the  estimators  applied  In  the  examples,  using  the  oomputer 
programs. 

These  examples  are  based  on  this  author's  personal  experiences 
Involving  agricultural  experimentation  while  working  for  the 
agricultural  consulting  group  of  Institute  of  Food  and  Agricultural 
Sciences,  University  of  Florida.  The  data  given  and  the  circumstances 
described,  are  contrived  to  Illustrate  computational  techniques. 


Summary  Information  Required  to  Compute  Estimators. 


Restricted 


Empirical  Bayes  • 


A.R.1  Example  1 : Hematode  Study 

A 3»3  factorial  experiment  was  conducted  to  determine  the  effect  or 
factors  A (nematoctde)  and  B (fertilizer)  on  the  number  of  nematodes 

compared.  Also  three  fertilizers  were  being  evaluated.  The  experimental 
units  were  potted  orange  trees  in  a large  citrus  nursery.  The 
application  of  the  nine  factorial  combinations  of  A and  B was  applied 
randomly,  so  that  each  factorial  combination  was  applied  to  twelve 


Unfortunately,  several  trees  were  destroyed  following  the 
application  of  the  treatments,  and  before  soil  samples  were  obtained, 

responses  are  listed  for  each  tree.  Note  there  Is  not  equal  replication 
for  each  factorial  combination.  Using  SAS,  an  analysis  of  variance  was 
performed.  The  ANOV  results  are  shown  in  Table  A. 3. 


’,:S 
i:ffi S 


i 


i 


!:3S 

ill 


IS 

is 


1 I 


Experiment. 


52.335 

19.180 

8.93*1  1.05  (pval  - .3653) 


least  squares  estimate  of  oell  means,  assuming  no  interaction.  A 
preliminary  test  strategy  using  0-.25  would  choose  the  restricted 
estimator  in  this  example.  That  is  reflected  in  Table  4.4.  Also,  the 
positive  part  versions  of  the  compromise  estimators  being  studied  are 
listed  in  Table  8.4.  These  estimators  were  computed  using  the  computer 
programs  listed  In  Appendix  B. 

Appendix  B.  The  choice  of  0,-  .478837  Insures  that  the  James-Stein 
positive  part  estimator  will  be  minlmax  for  estimating  cell  means. 

Also,  Table  4.4  lists  the  various  estimates  of  marginal  means. 

In  Figures  4.1  and  4.2,  geometric  Interpretations  of  the  compromise 
made  using  the  shrinkage  estimators  are  displayed.  Note  that  every 
element  of  the  James-Stein  positive  part  estimator  la  shrunk  by  the  same 
amount,  from  the  OLS  estimator  toward  the  restricted  estimator.  The 
elements  of  the  empirical  Bayes  positive  part  estimator  are  all  adjusted 
by  different  amounts.  The  idea  of  graphing  the  estimators  in  this  way 
oomes  from  Casella  (1985). 
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Figure  t.2  Geometric  Interpretation  of  James-Steln  Estimate  of  Marginal 
Means  Using  Nematode  Study.  Diamond  is  Empirical  Bayes 


Restricted 


Ferlilixer 


Legend:  o - Nematooide  1 , • ■ Nematocide  2,  ■ • Nematocide  3 


Figure  M.3  Impact  on  Compromise  Estimators  on  Interpretation  of  Results 
in  Nematode  Example. 


compromise  estimators 


where  nematoclde  2 
lat  fertilizer  3 ma; 
5 estimator) . 


marginal  means,  using  the  various  estimators,  for  this  experiment. 
Additionally,  MSE  ■ 1 and  the  Interaction  F statistic  If  computed  will 
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Figure  n.5  Geometric  Interpretation  of  Jamea-Steln  Estimate  of  Harginal 
heano  Using  Example  2.  Diamond  la  Empirical  Bayes 


Figure  *1.6  Impact  of  Compromise  Estimators  on  Interpretation  of  Results 
in  Example  2. 


is  R,Ie,u>,  and  R2(e,u>  w 


D2(e)  - Rjts.ji)  - R2<;.£), 


(M.2) 


Empirical  Bayes  positive  part 


g - t(a-l ) (b-1 )-23[N-ab-E]/[(a-l ) (b-l ) (N-ab*2)]»  (1.3 

as  the  shrinkage  constant.  Recall  from  previous  discussion  that  the 
oholce  of  g given  in  (b.3.3)  will  cause  the  Empirical  Bayes  positive 
part  estimator  to  emulate  the  James-Steln  positive  part  estimator  with 

factorial  experiment  are  all  equal. 

Two  situations  were  considered:  an  unbalanced  3x3  factorial 
experiments,  and  a balanced  3«3  factorial  experiment.  Both  of  these 
situations  were  constrained  to  have  N-27  total  observations  in  the 
faotorlal  experiment.  In  Table  R.7  the  number  of  observations  per  cell 
for  each  situation  is  given. 


Table  k.7  Cell  Sizes  Considered  In  the  Simulations. 


Situation  1 


Situation  2 


3 

3 

3 

3 

3 

3 

3 

3 

jl 

of  Interaction  that  exists  In  u ha 
using  the  biased  estimators  being 
patterns  of  Interaction 


Interaction,  as  well  as  the  amount 
an  Influence  on  the  risk  Incurred  by 
udled.  Therefore,  eight  different 
Tor  situation  1-  These  patterns 
'n  Appendix  A,  details  about 

representative  of 


these  choices  of  interaction  pattern 
suffices  to  say  that  these  patterns  c 
the  population  of  all  possible  Interaction  patterns. 

For  each  pattern  of  Interaction,  amounts  of  Interaction 
corresponding  to 


were  considered.  Recall  that  A Is  the  Interaction  F statistic's 
noncentrallty  parameter  as  in  (A. 1.6). 


o only  one  pattern  o 


considered  In  situation  2 as  were  In  situation  1. 


simulation,  data  were  generated  to  correspond  to  the  cell  sizes  given  In 
generator  called  RANNOR,  in  5AS.  Onto  this  random  error.  Interaction 


was  added  corresponding  to  each  pattern  and  amount  of  Interaction  being 
considered. 


I 

3 


ill 

al  :-3;5K-5:-s 


ll  :-3:-35S;-53 


L,(e)  - 

M«>  • Ce  - j,)'D(e  - u). 
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estimates  were  estimated.  In  Tables  9.9  through  9.16  the  results  Tor 
situation  1 are  tabulated.  Results  for  situation  2 are  reported  in 


Using  RSI,  Dj (e)  and  D2(£>  were  charted  against  the  noncentrality 
parameter,  1.  In  Figure  9.7  the  charts  for  DjCi?)  are  displayed  for  each 
Interaction  pattern  in  the  unbalanced  case.  Similarly,  Figure  9.6 
displays  the  charts  for  D2(£)  for  each  interaction  pattern  in  the 
unbalanced  case. 


Only  the  chart  of  D^ie)  versus  lambda  (Figure  9.9)  is  required  for 

estimators,  when  the  numbers  of  observations  per  cell  are  equal.  AIsd 
it  can  be  noted  in  Figure  9.9  or  Table  9.11  that  the  Empirical  Bayes 
positive  part  estimator  has  exactly  the  same  risk  as  the  James-Steln 
positive  part  estimator  when  cell  sizes  are  equal. 

Based  on  the  two  situations  considered,  the  two  shrinkage 
estimators  tended  to  have  less  risk  in  estimating  cell  or  marginal  means 
as  compared  to  the  OLS  and  preliminary  test  estimators.  Admittedly  the 
gains  of  the  shrinkage  estimators  were  in  some  cases  modest.  Even  so 
the  practicing  data  analyst  generally  does  not  know  the  pattern  of 
Interaction  a priori.  At  any  time,  the  pattern  of  interaction  and  the 
pattern  of  unbalance  in  an  experiment  may  be  such  that  the  shrinkage 
estimators  provided  substantial  Improvement  over  OLS  and  preliminary 


The  fact  that  shrinkage  estimators  have  smaller  risks  is  of  little 
value  to  the  data  analyst,  unless  this  property  can  be  capitalized  on  by 


0 ii 
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0090  .0068 


05«  -.036 

0079  .0063 


059  -.036 

0073  .0061 


095  -.078 
0131  .0123 


Table  a. 17  Risk  Increase  ( D] ) of  the  Biased  Estimators  over  OLS 
Estimator,  Situation  2,  Table  t.7.  Risk  inorease  in 


Empirical 
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the  OLS  Estlmate'of  t! 


figure  1.8  Increased  Sisk  Da  or  Biased  Estimates  of  Marginal  Means  ove 
«h7  °LRisktinorease  In*  9*rg{“1  '1ean3'  Situation  1,  Table 


DI  vs  late 


providing  smaller  confidence  intervals  of  linear  combinations  of  t 
cell  means.  In  chapter  5 confidence  Intervals  based  on  the  James- 
estlmator  are  developed,  applied  In  examples,  and  compared  against 


confidence  intervals 


upon  the  estimation  strategies  described  in  chapter  3.  In  section 

factorial  experiment  examples  given  in  chapter  A,  using  each  of  the 
described  confidence  Intervals.  Using  Monte  Carlo  experimentation, 
coverage  probabilities  and  expected  half-widths  for  the  various 


5.'  Motivating  Interval  Estimation  Strategies 
5 Confidence  Interval 

OLS  point  estimator  of  1/  8_  is  t).  The  corresponding 


Note  that  t(dfe,a/2>  is  the  {a/2)!00  percentile  of  the  central  t 
distribution  with  dfe  degrees  of  freedom.  Also,  df8  is  the  degrees 
freedom  associated  with  s , the  MSB.  Coverage  probability  for  the 
(l-o)IOOJ  confidence  Interval  is  exactly  (l-a)lOOJ.  other  Interval 
estimation  strategies  will  be  described  that  achieve  smaller  expected 
half-width  than  this  OLS  confidence  interval.  Unfortunately,  the 
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coverage  probabilities  for  these  Interval  estimation  strategies  are  not 

5.1.2  Restricted  Least  Squares  Confidence  Interval 

If  the  estimator  of  £ Is  constrained  to  U :RS-0)  the  resulting 
point  estimate  of  _1'  £ will  be  l'(I-HR)b  . The  corresponding  (l-o)IOOJ 
oonfidenoe  Interval  for  1/  £ Is 

l'(I-MR)b  t t(dfe,o/2)  ( l'U-RRls'1!  s2)  ^ (5.1.2) 

interval  will  have  exactly  (i-a)100J  coverage  probability.  When  the 
constraint  does  not  hold,  the  restricted  least  squares  confidence 
Interval  may  not  maintain  the  desired  coverage  probability.  The  half- 
width for  the  restricted  least  squares  Interval  is  never  larger  than 
that  of  the  OLS  confidence  Interval.  For  some  choices  of  1,  the 
restricted  least  squares  confidence  interval  will  be  smaller  than  the 


1-3  Preliminary  Test  Confidence  Interval 

By  testing  the  hypothesis  H0:RJS-0  to  determine  whether  tl 


estimate  £ a preliminary  test  estimator  is  being  used.  Furthermore,  if 
the  estimate  of  VjS  takes  on  one  of  two  different  forms  depending  on  the 
test  of  hypothesis,  then  a preliminary  test  estimate  of  l’B  is  being 
employed.  Similarly,  a preliminary  test  oonfidenoe  interval  takes  on 
one  of  two  different  forms,  depending  on  the  outcome  of  the  test  of 


hypothesis.  Specifically, 


following  interval  estimation  strategy 


preliminary 


confidence  Interval: 


1.  Test  Ho:R£-0  using  the  appropriate  F statistic. 


This  preliminary  test  confidence  Interval  may  be  written  using  indicator 
functions  as 

1 ' (6  ♦ H (!-I(0  .(F))  Rb)  ± 

t(dfe.0/2)  (l'(  (I-MR)S-1  * M( J-I{0  c)(F))RS'')l  s2  ) (5.1.3) 
where  6 - (I-MR)b  as  in  chapter  3. 

severe  compromise  between  the  OLS  confidence  Interval  and  the  restricted 
least  squares  confidence  Interval.  Next  a compromise  between  the  two 
extremes  will  be  described  that  is  motivated  by  the  James-Stein 
compromise  estimator  in  chapter  3. 

5. 1.1!  James-Stein  Confidence  Interval 

Hwang  and  Casella  (1982)  and  Hwang  and  Chen  (1986)  developed  and 
studied  a confidence  interval  strategy  in  which  the  James-Stein  point 

therefore  just  as  wide  as  the  OLS  Interval.  In  this  work  an  attempt  will 


Interval  half  width.  The  motivation 


the  applied  researcher  can  realise 
iey  result  In  confidence  Intervals  o 


value  of  shrinkage  estimators 


uses  a shrinkage  technique  in 
chapter  3.  and  strives  to 


attain  (l-o)IOOJ  coverage  la 


(c/F)(I-MB)S-‘  lit1  (5.1.4) 


shrinkage  constant  described 
for  this  confidence  Interval. 


restriction  become 


e transformation  matrix  1 : 


Important  properties 


e corresponding  James-SI 


Var(BJ>  - w"'  Var(  eS  ) w'1 
(1-o/FJl  ♦ (o/PHI  J j ) 


(5.1 

(5.1. 


Using  properties  of  H as  in  (5.1.8). 


Var(  8S  ) - C(1-0/F)s',.(c/P)(I-HR)s',]s2  (5.1 


The  (1-3)1 001  confidence  . 
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5.2  Example:  Nematode  Study 

As  the  compromise  estimators  were  applied  in  chapter  A to  the 
factorial  experiment,  these  Interval  estimation  stategles  can  be  applied 
to  the  factorial  experiment.  Specifically,  (l-o)IOOJ  confidence 

he  cell  means  can  be  computed 


ie  described  strategies, 
le  first  example  of  chapter  A 


intervals  for  the  cell  and  marginal  means 
required  to  obtain  confidence  intervals  fi 


means  and  marginal  means 
f chapter  3.  Confidence 


s chapter.  The  calculations 


I,:  V . where  1,  •-  (1/3 


1/3  0 0 0 0 0 0)  . 


u,.  t tOZ.-OZSKl,: 


From  a table  of  critical  value  for  the  central  t distribution,  it  oan  be 


(5. 


.3) 


7 * 1/5J/9  - .0A92. 


Referring  back  to  Table  4,1  to  get  u1  , and  Table  4.3  to  get 
95*  confidence  Interval  is 


6.209  ± 2( .0492*4. 204 )M? 
which  is  6.209  ± .910 

The  95*  restricted  least  squares  confidence  interval  Tor 
u,.  t t<72,  .025)  (1, ; C I-MR)s"’  l,.,2)’* 
Program  1 in  Appendix  B lists  (I-MR)S-'  as  part  of  its  output, 
quadratic  form 


1, ; ( I-MR)S~^ 


.0465  . 


Substituting  the  specific  values  into  <5.2.4),  the  95$ 
confidence  Interval  is 


.0465*4. 204  )Mi 


0.0118669  0.0169297 
0.00900983  -0.00816953 
-0.00979766  0.0100798 
-0.00903896  -0.0053925 
0.00920951  -0.00675963 
-0.00959798  0.0119898 
-0.00383878  -0.0039376 


COL3 
0.0198669 
0.0169297 
0.196565 
-0.00657931 
-0.00951697 
0.0155569 
-0.00899553 
-0.0068827  ■ 

0.0131902 


0.0108999 

-0.00975966 

0.0101228 

-0.00997398 


-0.00903896 

-0.0053925 

-0.00699057 

-0.00829961 


0.00920951 

-0.00675963 

-0.00899553 

-0.00975966 

-0.00699057 

0.080707 

0.00996187 

0.00777597 


-0.00959798 

-0.0068827 

-0.00595989 

0.0101228 

-0.00829961 

0.00996187 

0.0808256 

0.00767715 


-0.00383878 

-0.0039376 

0.0131902 

-0.00937966 

-0.00997398 

0.0126593 

0.00777597 

0.00767715 

0.0709557 


The  preliminary  teat  confidence  interval  with  pretest  a-. 25  will  in 
this  case  coincide  with  the  restricted  least  squares  confidence 


interval,  since  the  interaction  p-va 
The  95*  James-Stein  confidence 


(5. 


.6) 


where  D - Bln(1,eI/E’)(l-Wt)S"1  * (l-mind.Oi/FJJS-1  . The  choice  of  o, 
will  be  that  same  one  used  In  the  estimation  example  of  chapter  4.  The 
third  program  In  Appendix  8 lists  D as  part  of  its  output.  In  Table 
5.2,  the  elements  of  D are  reported  for  this  example.  Using  the  numbers 
in  Table  5.2,  the  quadratic  form  can  be  evaluated: 


Substituting  the  specific  values  into  (5.2.6)  , the  95*  James-Stein 
positive  part  confidence  Interval  is 

6.20#  t 2(.0480«4.204)'£. 
or  6.204  t .898 

Using  similar  computations,  the  confidence  intervals  for  all  the  cell 


marginal 


|/FKI-K 


0.0617222 

0.0311986 

0.0328775 

0.0199138 


R0W6  -0.00893088 
R0H7  0.0203559 
R0W8  -0.0101682 
ROW  -0.00898929 


-0.00893088 

-0.0118197 

0.0399029 

0.0259779 

0.0290936 

0.0703106 

-0.0182326 

0.0279895 


0.0715953 

0.0379399 

-0.0180555 


-0.0199986 

•0.00870783 


0.0328775 

0.0379399 

0.0818298 

-0.00998799 

0.0399029 

-0.0197827 

-0.0152208 

0.0291696 


199138 


-0.0106098 

0195999  -0.00998799 

.0239717 
.0563727 
.0290936 


0.0203559 

-0.0199986 

•0.0197827 

0.0297893 

■0.0105197 

0.0153988 

0.0573393 

0.0220303 


0101682 

025398 

52208 

01318 

0223862  ■ 


3.00898929 

3.00870783 

3.0291696 

3.00967937 

3.00989291 

3.0279895 


5.3  Confidence  Intervale  ft 


Comparls 


The  OLS  confidence  interval  given  in  (5.1.1)  has  exactly  a 
(i-o)IOOJ  coverage  probability.  The  coverage  probabilities  for  the 
other  confidence  Intervals  described  in  section  5.1  may  vary,  depending 
on  the  size  and  pattern  of  Rfl.  In  this  section,  results  of  a simulation 
comparison  of  the  various  confidence  interval  strategies  are  given. 
Specifically  the  OtS,  Restricted,  Preliminary  Test  (a-. 25)  and  James 
Stein  ♦ 95J  confidence  intervals  for  oell  means  and  marginal  means  are 
compared.  The  restriction  under  consideration  is  the  additivity 


5.3*1  Simulation  Description 

The  same  situations.  Interaction  patterns  and  amounts  as  were  used 


Interval  comparison.  The  data  generation  technique  la  also  the  same  as 
the  technique  in  section  A. 3. 

Intervals  are  computed  for  the  nine  cell  means  and  the  three  marginal 


means  of  A.  These  confidence  Intervals  are  computed  using  each  of  the 
four  confidence  Interval  strategies  under  study.  For  each  pattern* 
amount* interval  strategy  combination,  coverage  probabilities  and 
expected  half  widths  of  the  various  confidence  Intervals  are  estimated 
by  averaging  over  the  N-200  simulations. 

situations  being  simulated  are  given  in  Table  5. A. 


Considered 


Simulations. 


Situation  2 


e following  numbering  ol 


Table  5.5  Numbering 


3»3  Layout. 


half  width  values  were  obtained  with  eight  different  patterns  and  eight 
different  amounts  of  interaction.  The  patterns  of  Interaction  were  the 
same  as  those  used  in  section  0.3.  The  amounts  of  interaction  were  J - 
0,  .05,  1,  1.5,  2,  3-125,  5.12  and  8.  The  total  number  of  coordinates 
(estimated  coverage  probability,  average  half  wl 
e Intervals  in  situation  1 was 


t strategies) .(9  cells  * 3 marginals) ■ ( 6 amounts) ,(8  patterns) 
■ 3072. 


The  large  number  of  coordinates  made  it  prohibitive  to  include  them  In  a 
table.  Therefore,  summary  graphs  are  used  to  demonstrate  the  findings 
of  the  simulation. 

Results  for  each  cell  and  marginal  mean  are  displayed  in  Figures 
5.1  through  5.12,  respectively.  Notice  that  all  the  results  of 
simulating  cell  one  are  shown  in  Figure  5.1.  Separate  graphs  in  Figure 
5.1  contain  the  60  coordinates  observed  for  each  of  the  four  confidence 


The  following  observations  may  be  made  upon  review  of  Figures  5.1 


through  5.1 


always  has  the  largest  average  half  width. 

The  95?  restricted  confidence  Interval  achieves  the  smallest 

coverage  decreases.  In  several  cases,  coverage  approaches  0?. 
The  95?  preliminary  test  (a-. 25)  confidence  Interval  offers  a 
compromise  between  the  average  half  widths  of  the  015  and  the 

average  half  widths  of  the  OLS  and  the  restricted  confidence 
interval  were  most  different,  the  coverage  probability  was 
substantially  debased.  Specifically,  for  Figures  5.3,  5.5,  5.1 
and  5.7  coverage  probability  got  as  low  as  .6.  The  coverage 
probability  was  most  effected  for  moderate  amounts  of 
interaction  Cl  < 1 < 3).  This  is  the  range  in  which  the  F teal 
for  interaction  is  not  very  powerful,  ai 
choosing  the  restricted  confidence  intei 
confidence  interval  i3  substantial  in  ti 
reduction.  The  coverage  probability  wai 
noticeably  in  Figures  5.10  and  5.12  for 
and  A-3.  The  reason  that  the  coverage  probability  is  not  more 
severely  effected  for  the  marginal  means  is  that  in  this  3«3 
case,  the  coverage  reduction  of  the  restricted  confidence 
interval  is  small  for  moderate  amounts  or  interaction. 

The  95?  James  Stein  * confidence  interval  offered  a compromise 


ie  consequence  ol 


ilso  effected 
ie  marginal  means 


f 


» § 


II 


12 


'32 


13« 


136 


137 


Coverage  probability  w; 


cells  that  the  preliminary  confidence 


was  debased. 


Coverage  for  the  James  Stein  * 


confidence  Interval  got  as  low  as  .8  in  some  cases.  In  every 
cell,  and  every  marginal  mean  simulated,  the  James  Stein  + 
confidence  Interval  achieved  better  coverage  than  did  the 
preliminary  test  confidence  Interval. 


Performance  coordinates  wt 


Simulation  of  the  9 5*  confidence 
s in  situation  2 was  performed. 

125,  5.12  and  8.  Since  the  cell  sample 


sizes  are  equal,  all  nine  cell  means  confidence  intervals  should  have 
the  same  performance  characteristics,  for  a particular  interval 
estimation  strategy,  and  rixed  i.  Therefore,  in  Figure  5.13  all  nine 
cell  means  are  Included  in  each  graph.  From  Figure  5.13  it  appears  tl 
the  James  Stein  * confidence  Intervals  are  not  as  severely  effected  bj 


interaction  as  were  the  preliminary  test  confidence  Intervals. 

In  Figure  5.19  the  performances  of  the  confidence  Intervals  for 
cell  mean  6 are  compared  for  the  unbalanced  situation,  with  interaction 
pattern  1.  In  this  figure,  the  advantage  of  the  James-Stein  confidence 
interval  over  the  preliminary  test  interval  is  clearly  displayed. 
Performances  of  the  confidence  intervals  for  the  A-3  marginal  mean  are 
compared  in  Figure  5.15.  Again  the  James-Stein  confidence  Interval  is 
less  severely  affected  by  increasing  Interaction. 


mi  6 iNiEBtuoN  rantEM  1 


Legend:  0 - OLS,  R - Restricted,  P ■ PT,  S - James  Stein 
Figure  5. 1 'l  Estimated  Coverage  Probabilities  and  Average  Half  W. 
Unbalanced  Situation. 
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Legend:  0 ■ OLS,  R - Restricted.  P - PT,  S - James  Stein  * 


Figure  5.15  Estimated  Coverage  Probabilities  and  average  Hair  Widths 
for  the  Various  Confidence  Intervals  of  a-3  Marginal  Mean 
In  the  Unbalanced  Situation. 


5.3*3  Conclusions 

Tne  strategy  or  Interval  estimation  based  on  a restriction 
(additivity)  allows  a reduction  In  expected  half  width  from  the  expected 
half  widths  of  the  corresponding  OLS  confidence  Interval.  As  the  size 
of  nonadditivity  (Interaction)  Increases,  the  coverage  probability  for 
the  restricted  confidence  Interval  decreases.  For  this  reason,  the 
restricted  confidence  Interval  strategy  Is  unacceptable. 

The  preliminary  test  (for  Interaction)  interval  estimation  strategy 
allows  a reduction  In  expected  half  width  rrom  that  of  the  OLS 
confidence  Interval,  as  does  the  James-Steln  * interval  estimation 
strategy.  Unfortunately,  neither  strategy  guarantees  (l-a)lOO*  coverage 
probability.  The  James-Steln  • strategy  seems  to  hold  its  coverage 
probability  a little  closer  to  (l-o)IOO*  than  does  the  preliminary  test 


CONCLUSION  AND  AREAS  OF  FUTURE  RESEARCH 
In  this  chapter,  the  oonclusions  that  can  be  drawn  f ran  this  study 
described. 


6-'  Weighted  Squares  of  Weans  vs  Method  of  Fitting  Constant 
In  chapter  2,  two  methods  of  testing  for  the  significance  of  a main 
effect  In  the  two-way  factorial  experiment  were  described.  In  the  case 
that  the  cell  sample  sites  are  unequal,  the  two  methods  can  lead  to 
conflicting  conclusions  about  main  effects.  The  weighted  squares  of 
means  method  was  shown  to  be  an  unbiased  testing  method.  The  method  of 
fitting  constants  method  was  shown  to  be  more  powerful  than  the  weighted 
squares  of  means  method,  at  the  expense  possible  bia3.  The  bias  of  the 


method  of  fitting  constants  test  is  shov 
sample  ceil  sixes  are  extremely  unequal 


As  noted  in  chapter  2,  Bancroft  (1968)  recommends  that  a 
preliminary  test  for  significance  of  Interaction  be  used  to  guide  in  the 
choice  of  main  effect  testing  method.  Because  the  power  of  the 

expected  that  such  a pretest  test  will  have  unacceptable  bias  also. 

Consideration  or  the  pretest  test  strategy  motivated  the  research 
on  estimation  and  confidence  intervals  that  is 


1«3 


presented  in  chapters  3 


through  5.  Pretest  estimators  have  been  noted  to  be  Inferior  to  the 
shrinkage  estimators  by  Sclove,  Morris  and  Radhakrishan  (1972)  and  many 
others.  In  chapter  9,  application  of  shrinkage  estimators  to  the  two- 
way  factorial  experiment  was  made  In  an  effort  to  determine  Just  how  the 
shrinkage  estimators  might  be  beneficial.  In  chapter  5,  the  concept  of 
the  pretest  confidence  interval  was  introduced,  a confidence  Interval 
centered  about  a shrinkage  estimator  was  developed  as  a competitor  to 
the  pretest  confidence  interval.  Ultimately,  study  of  the  shrinkage 

competitor  to  the  pretest  test  proposed  by  Bancroft  (1968). 


6.2  Compromise  Estimators  In  Factorial  Experiments 
In  chapter  3,  description  and  development  are  given  for  the 
preliminary  test  estimator,  and  Its  competitors— the  shrinkage 
estimators.  In  chapter  9,  the  estimation  strategies  are  applied  ti 
factorial  experiment.  It  Is  shown  by  example  that  computation  of  i 


relatively  simple  task.  An  empirical  Bayes  estimator  requires  more 
complicated  computation,  but  can  be  programmed  for  the  computer.  Based 
on  the  examples  that  are  considered,  the  James-Stein  estimator  and  the 
empirical  Bayes  estimator  result  In  very  similar  cell  and  marginal  means 


A simulation  experiment  was  used  to  compare  the  performance  of  the 
preliminary  test,  James-Stein  and  empirical  Bayes  estimators  of  cell  and 
marginal  means.  As  might  have  been  expected,  the  shrinkage  estimators 


marginal 


average.  That  Is.  the  risks  as  defined  In  section  3.2  were  smaller  Tor 
the  shrinkage  estimators  than  for  the  preliminary  test  estimator.  The 
differences  in  risk  for  cell  mean  estimation  were  large  enough  in  the 
unbalanced  situation  to  be  of  practical  Importance  in  this  author's 
opinion. 

In  terms  of  risk  for  the  marginal  means,  the  differences  are  not 
necessarily  large  enough  to  warrant  shrinkage  estimation  over 
preliminary  test  estimation.  In  situations  of  extreme  cell  sample  size 
unbalance,  the  use  of  shrinkage  estimators  for  the  marginal  means  may 
provide  practically  significant  improvement,  although  the  cases  studied 
in  this  work  do  not  document  that  phenomenon.  Future  research  in  this 
area  will  attempt  to  Identify  cell  sample  size  patterns  that  allow 
substantial  improvements  by  using  shrinkage  estimators. 

In  the  cases  studied  in  this  work,  the  differences  between  risks  of 
the  James-Stein  estimators  and  the  empirical  Bayes  estimator  were  not 
large  enough  to  be  of  praotlcal  Interest.  In  this  author's  opinion,  the 
empirical  Bayes  estimator  that  is  proposed  In  chapter  t is  probably  not 
worth  the  extra  computational  complexity  that  It  requires. 


6.3**  0L5  Confidence  Interval 

The  OLS  confidence  interval  strategy  guarantees  (I -a) 100%  coverage 
probability  Tor  linear  functions  of  oell  means  In  the  factorial 
experiment.  The  coverage  probability  is  uneffected  by  additivity  or 


nonaddltlvity.  For  many  researchers,  the  exact  coverage  probability 
so  attractive  that  all  or  the  other  methods  described  in  chapter  5 are 
unacceptable.  It  should  be  noted  that  the  exact  coverage  probability 
hinges  on  the  assumption  of  normally  distributed  experimental  error. 
There  are  very  few  experimental  situations  In  which  the  normality 
assumption  Is  actually  true.  Therefore,  the  (l-o)IOOJ  coverage 
probability  Is  an  approximation  In  practical  application. 

6.3.2  Restricted  Confidence  Intervals 

Assuming  additivity  In  a factorial  experiment  can  afford 
substantially  narrower  confidence  intervals  for  linear  functions  of  cell 
means  compared  to  the  OLS  strategy.  The  coverage  probability  can  be 
severely  degraded  when  the  additivity  assumption  Is  Inoorrect.  There 
are  conaelvably  situations  In  which  the  physical  mechanisms  involved  In 
the  experiment  prohibit  the  possibility  of  Interaction.  In  such  cases 
the  restricted  confidence  intervals  would  be  preferrable  to  the  OLS 
confidence  Intervals.  More  orten  though,  the  presence  of  Interaction 
unknown,  and  the  assumption  of  additivity  Is  fraught  with  danger. 

6*3-3  Preliminary  Test  Confidence  Interval 

The  preliminary  test  Tor  Interaction  Is  often  used  In  practice  to 
facilitate  the  choice  between  OLS  and  restricted  confidence  Intervals. 
The  preliminary  test  confidence  Interval  that  Is  developed  In  chapter 
accurately  reflects  such  a decision  strategy.  The  preliminary  teat 
confidence  Interval's  performance  Is  effected  by  the  size  of  the 
Interaction  test  and  the  amount  and  pattern  In  which  Interaction 
occurs.  The  reduction  in  average  hair  width  that  the  PT  confidence 
interval  affords  does  come  at  the  expense  of  reduced  coverage 


probability. 


6.3.1 


iund  of  coverage  probability  given  tl 
a particular  linear  Function  of  the 
a being  computed  to  capture. 
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For  many  experimenters,  the  reduction  ii 
using  a shrinkage  estimator  is  useless,  unlei 

OLS  counterpart.  In  chapter  5,  an  Interval 
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The  James-Steln  confidence  ir 
the  OLS  confidence  Interval.  Although  the  coveraj 
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relation  to  the  James-Stein  point  estimation  strategy,  the  James-Stein 
confidence  interval  that  is  proposed  does  merit  consideration  for 
practical  application.  Specifically,  the  researcher  that  has  chosen  the 
James-Stein  estimation  strategy,  based  on  its  superiority  to  preliminary 
test  estimation,  would  naturally  use  the  James-Stein  confidence 
intervals  to  obtain  approximate  interval  estimates. 


strategies,  t 
(1983a)  could 


e research  in  the  area  of  compromise  confidence  interval 
e empirical  Bayes  confidence  intervals  described  by  Morris 
perhaps  be  applied  to  the  factorial  experiment  setting, 
added  complexity  of  such  a confidence  interval,  large 
n performance  over  other  confidence  intervals  would  have 


practice. 


Another  idea  for  future  study  is  the  study  of  compromise  confidence 
interval  performance  in  a simultaneous  Interval  estimation  strategy.  It 
is  noted  by  Lee  (1983)  that  compromise  estimators  do  not  provide 
Improvement  over  OLS  estimation  in  estimating  an  individual  component  of 
the  mean  vector.  The  value  of  compromise  estimators  is  realized  in  the 
estimation  of  mean  vectors  of  dimension  3 or  greater.  It  seems  a 
feasible  parallel  to  Imagine  that  the  value  of  compromise  confidence 
intervals  will  be  realized  in  the  simultaneous  interval  estimation  of  3 
or  more  independent  linear  combination  of  the  mean  vector. 

There  is  not  enough  evidence  in  the  work  on  compromise  confidence 


practice.  The  developed  compromise  confidence  Interval  should  only  be 
considered  as  a proposal  which  can  be  weighed  for  merit  in  future  work. 


6,t  Recommendations 

When  the  cell  sample  sizes  are  unequal,  do  r 
fitting  constants  to  test  the  significance  of  a e 
Use  a shrinkage  estimate  of  cell  means  rath< 
test  estimate  when  the  cell  sizes  are  unequal. 


APPENDIX  A 

GENERATING  REPRESENTATIVE  PATTERNS  OF  INTERACTION 
FOR  SIMULATION  OF  A TWO-WAY  FACTORIAL  EXPERIMENT 


In  chapter  k and  chapter  5.  computer  simulation  of  data 

for  performance  comparison  of  various  estimators,  and  confidence 
intervals.  In  the  case  that  the  number  of  observation  per  cell  in  a 
factorial  experiment  are  not  all  equal,  the  pattern  in  which 
interaction  occurs  in  the  data  can  have  an  effect  on  the  performance 


introduced.  It  was  therefore  necessary  that  several  different 
patterns  of  interaction  be  considered  in  the  simulations.  This 

are  representative  of  the  population  of  all  possible  Interaction 
patterns.  Specifically,  two  of  the  patterns  used  in  the  simulation 
were  chosen  because  they  were  known  cause  Rj  ( u.u_)  to  be  maximum  and 


the  population 


id  minimized  RgCjJ.ji)  t 


«.l  Patterns  Ttiat  Maximize  (Minimise)  R,  (u.u) 


R, (u.  u)  - EC  (u-uWji-u)  ) 


- * R,((MO,MRu)  .from  lemma  3.1.1 


- E(  ‘ ( I-MR ) 1 < I-MR ) ( u-u)  ) * Ei 


Following  the  reparameterization  of  Bock  et.al.  (1973).  let 


(A. 


CIj 


(A. 


orthogonal 
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where  A - [Ij  0]  <W-1 > • W'1  [Sj  0]’. 

From  OrayblU  (1969,  p.  309),  we  know  that 


where  d,  and  dj  are  the  largest  and  smallest  roots  of  A,  respectively. 

Take  e^j  and  to  be  eigenvectors  corresponding  to  d^  and  dj, 
respectively.  Also,  assume  ej,,  e())  - eJJ(  e(J)  - 1. 

By  properties  of  eigenvectors, 


fj'R’H'HRfj 
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is  the  largest  value  that  ^'R'M'MRu  can  attain.  Also,  if  jj  ■ fj  then 

So  £,  and  fj  represent  patterns  of  Interaction  that  allow  {A. 1) 
to  take  on  its  maximum  and  minimum  value  for  fixed  A,  respectively. 


Patterns  of  Interaction  that  Maximize  (Minimize)  R,( u,  u) 


where  D is  as  In  (3.2.3).  Let  £,  and  gj  hi 

i,  - w'tpn)  ««!,■»"  (fa)  »»•! 

The  matrix  A*  - [IjO]  'd'h-'  [IjO].  The  eigenvectors  oi 


1 ) *nd  -*d)  * 


(A. 9)  is  minimized,  a 


m Patterns  of  Interaction 


e following  algorithm  w< 


Generate  a veetor  z,  where  z ia  a realization  or  a NjfO, 1} 
random  vector.  Standardized  so  that 


In  Table  A.1,  the  patterns  of  interaction  that  were  used  in  the 
simulation  of  the  unbalanced  situation  (see  Table  **.5  or  Table  5. A) 
are  given.  Since  these  eight  patterns  span  the  realm  of  all  possible 

(in  Chapter  A)  and  confidence  interval  performance  fin  Chapter  5)  are 
ne  results  one  might  get  using  different  Interaction 


patterns. 
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In  this  appendix  simple  computer  programs  are  given  for  computing 

PROC  MATRIX.  These  programs  are  set  up  so  that  given  information, 

experiment,  the  average  responses  in  each  cell,  and  the  F statistic 
testing  Kq:  no  interaction,  the  compromised  estimators  oan  be 
computed.  The  following  programs  are  included: 


Program 


- Computes  restricted  estimator. 

will  insure  minimaxity  of  the  James-Steln  estimators 

- Computes  James-Stein  positive  part  estimator. 

- Computes  modified  Empirical  Bayes  positive  part 


program. 


example  output,  from  a run  of  the 


The  following  instructions  will  enable  a user  to  alter  these 
programs  so  that  they  apply  to  any  two-way  factorial  experiment: 


156 


The  sample  averages  for  each  factor  level  combination 
(ordinary  least  squares  estimators)  are  entered  by  the  user 


through  the 


The  value  of  the  P statistic,  testing  for  Interaction,  is 
entered  into  the  program  by  the  user: 


For  the  programs  that  compute  shrinkage  estimators,  the 
of  the  shrinkage  constant  may  be  specified  by  typing  in 
specific  number.  Zf  a constant  is  not  specified  by  the  i 
the  constant  will  take  on  a default  value.  Program  2 cai 

that  the  resulting 


estimator  will  be  mlnimax  with  respect  to  Rj (...)  as  in 
(3.2.1).  If  the  default  value  is  desired,  specify 


for  the  James-Steln  positive  part  estimator 
part-,  respectively. 


Empirical 


Bayes  positive 


7.10938 

5 ! 8283 
7.97603 
6. 69996 
9.86899 

b!s6791 


2)  0 LE  C LE  UPBND 


R0M1  O.H7W37 


IS  NOT  MET  WITH  THE  STANDARD  CHOICE 
A BETTER  CHOICE  SHOULD  BE  USED 


38ram  3 


9.556  8.137  9.036;  COMMENT  CELL  AVERAGES  ARE  GIVEN: 


G-( CA-1 )*(B-t )-2)*!N-AAB-2)A/((A-l )«(B-1 )*(N-A*B-2) ) ; 
VHAT-((N-A<B-2>»F«/!N-A*B)-1)*(A-1)#(B-1)  «/  TR; 
E_B-OLS-G#M"INV!VHAT#P  » IIRP)  )*R*OLS; 


COMMENT" THE  AMOUNT  OF  SHRINKAGE  INVOLVED  FOR  EACH  CELL  MEAN  IS 
COMPUTED; 

SHRINK-! E B-OLS)*/(REST-OLS); 

COMMENT  THE  ADJUSTMENT  TO  MAKE  THIS  A POSITIVE  PART  VERSION  IS  MADE 

IF  SHRINK! INDX, 1 ) LT  0 THEN  E_B( INDX. 1 ) -OLS! INDX , 1 ) ; 

IF  SHRINK! INDX. 1)  GT  1 THEN  E_B( INDX, 1 ) -REST! INDX. I ) ; 

SHRINK-!  E_B-OLS)#/(REST-OLS> ; 

PRINT  SHRINK; 

NOTE  EST  HAS  BEEN  SHRUNK  TOWARD  THE  RESTRICTED  ESTIMATE; 
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99937 

83008 


8.26075 

8.8199 


0.  *159892 
0.169622 
0.969889 
0.967138 
0.962815 
0.963993 


K TOWARD  THE  RESTRICTED 
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